Information input apparatus

ABSTRACT

An electronic camera records pictures and sound associated with the picture images, and enables reproduction of selected picture images. When one of the picture images of a range of continuously-shot picture images is reproduced, the sound corresponding to the entire range of continuously-shot picture images is reproduced.

INCORPORATION BY REFERENCE

[0001] The disclosure of the following priority application is hereinincorporated by reference:

[0002] Japanese Patent Application No. 08-152220, filed Jun. 13, 1996.

BACKGROUND OF THE INVENTION

[0003] 1. Field of Invention

[0004] The present invention relates to an information input apparatusfor use, for example, in an electronic camera or the like which recordsthe image of an object after converting the image into digital data.

[0005] 2. Description of Related Art

[0006] In recent years, use of electronic cameras which shoot the imageof an object using a CCD or the like, and which record the image in aninternal memory, such as an IC or removable memory cards, or the like,after converting the image into digital data, is becoming common inplace of cameras which use film. An image which is photographed withsuch an electronic camera may be retrieved immediately and be displayedon the screen of an LCD or the like without developing and printingprocesses required by a conventional camera.

[0007] Moreover, an electronic camera is compatible with personalcomputers because the electronic camera records the photographed imageas digital data, and hence an electronic camera is often used as aninput device for personal computers. For example, an electronic camerais often used as a tool to input image data in creating a home page forthe Internet. In addition, electronic cameras are capable ofcontinuously shooting the picture image of an object.

[0008] Certain electronic cameras are also capable of recording sound inconjunction with picture images of the object being shot. When onepicture image is reproduced, the sound associated with the picture imageis also output.

[0009] However, when a picture image is one of many continuously shotpicture images, a problem arises that the time during which the soundassociated with this picture image was recorded is relatively short. Forexample, when a picture image is one of a set of picture imagescontinuously shot at a rate of 8 frames per second, the time duringwhich the sound associated with each recorded picture image isone-eighth of a second.

SUMMARY OF THE INVENTION

[0010] The information input apparatus of the present inventionovercomes the disadvantages of the related art and outputs soundcorresponding to the picture image being reproduced such that the userdoes not notice a difference.

[0011] The information input apparatus of the present inventioncomprises imaging means for imaging a picture image and sound inputmeans for inputting sound. A memory stores the picture image imaged bythe imaging means and the sound corresponding to the picture image inputby the sound input means, with an association between the two. Thememory also stores a continuously shot picture image comprised of aplurality of picture images imaged continuously in a predeterminedlength of time by the imaging means and the associated sound input bythe sound input means during the predetermined length of time. Pictureimage reproduction means reproduces the picture images stored in thememory means, and sound reproduction means reproduces the sound storedin the memory means. Selection means enables selection of a prescribedchoice of picture images stored in the memory means, and control meanscontrols the components so that when a prescribed choice of pictureimages stored in the memory means is selected by the selection means,the picture image reproduction means reproduces the selected pictureimage and the sound reproduction means reproduces the soundcorresponding to the continuously shot picture image having this pictureimage as a constituent element.

[0012] In addition, the apparatus may be such that the sound is storedin the memory means with an association to each of the picture imagesthat compose the continuously shot picture image.

[0013] The apparatus may also be such that the control meansaccomplishes control so that when one of the picture images that composethe continuously shot picture image is selected by the selection means,the sound reproduction means reproduces the sound corresponding to thecontinuously shot picture image from the start.

[0014] In addition, the apparatus may be such that the control meansaccomplishes control so that when one of the picture images other thanthe picture image imaged first is selected by the selection means out ofthe picture images that compose the continuously shot picture image, thesound reproduction means reproduces the sound corresponding to thecontinuously shot picture image from the middle.

[0015] The apparatus may also be such that the memory storespredetermined information indicating whether or not a picture image isone of a continuously shot picture image.

[0016] In another aspect, the apparatus may further comprise a displayfor displaying the picture images imaged by the imaging means and thepicture images reproduced by the picture image reproduction means, andsound output means for outputting the sound input by the sound inputmeans and the sound reproduced by the sound reproduction means.

[0017] The apparatus may also include illumination means for emittingilluminating light toward the object.

[0018] In the information input apparatus of the present invention,control is accomplished by the control means so that when a prescribedpicture image of the picture images stored in the memory means isselected by the selection means, the picture image reproduction meansreproduces the selected picture image and the sound reproduction meansreproduces the sound corresponding to the continuously shot pictureimage of which the picture image is a constituent element. Accordingly,when one of the picture images that compose a continuously shot pictureimage is reproduced, all of the sound recorded during the continuousshooting can be reproduced.

BRIEF DESCRIPTION OF THE DRAWINGS

[0019]FIG. 1 is a front perspective view of an embodiment of anelectronic camera of the present invention.

[0020]FIG. 2 is a rear perspective view of the electronic camera shownin FIG. 1.

[0021]FIG. 3 is a perspective view showing the internal composition ofthe electronic camera shown in FIG. 2.

[0022]FIG. 4 is a block diagram showing the electrical circuitry of theelectronic camera shown in FIG. 1.

[0023]FIG. 5 is a diagram of an example of a display screen of theelectronic camera shown in FIG. 2.

[0024]FIG. 6 is a flowchart showing the sequence when one of the pictureimages comprising a continuously shot picture image is reproduced.

[0025]FIG. 7 is a diagram showing that the picture images comprising thecontinuously shot picture image and the sound have a one-to-onecorrespondence.

[0026]FIG. 8 is a diagram showing that the picture images comprising thecontinuously shot picture image and the sound have a many-to-onecorrespondence.

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS

[0027] The electronic camera of the present invention is shown in FIGS.1 and 2. For purposes of orientation, surface X1 faces the object whenan object is photographed and surface X2 faces the user. As shown inFIG. 1, the top edge section of the surface X1 includes a viewfinder 2which is used to verify the shooting range of the object, a shootinglens 3 which takes in the optical image of the object, and alight-emitting unit (strobe) 4 which emits light to illuminate theobject.

[0028] The top edge section of surface X2, as shown in FIG. 2, includesan opposite end of viewfinder 2 and a speaker 5. Speaker 5 outputs soundcorresponding to sound data recorded on a memory card or the likeinstalled in electronic camera 1. Moreover, an LCD 6 and operation keys7 are formed in surface X2 below viewfinder 2, shooting lens 3,light-emitting unit 4, and speaker 5. On the surface of LCD 6, a touchtablet 6A is formed which outputs position data corresponding to theposition designated by the touching operation of a designated pen-typepointing device or pen 6B.

[0029] Touch tablet 6A is made of transparent material such as glass orresin, and allows the user to view an image being displayed on LCD 6,which is formed inside touch tablet 6A, through touch tablet 6A.

[0030] Operation keys 7 include a plurality of keys corresponding to aplurality of functions as described hereafter. The keys may be operatedby pen 6B and are used to reproduce recording data such as image data,sound data or text data recorded on the internal memory card and todisplay such on LCD 6. For example, a menu key 7A is operated to displaya menu screen on LCD 6. An execution key 7B is operated to producerecording data selected by the user. In addition, a clear key 7C isoperated to erase the recording data, a cancel key 7D interrupts thereproduction process of the recording data, and a scroll key 7E scrollsthe screen vertically when a table composed of the recording data isdisplayed on LCD 6.

[0031] A microphone 8 to gather sound and an earphone jack 9 to which anearphone (not shown) is connected are provided in top surface Z ofelectronic camera 1.

[0032] A release switch 10 which is operated in shooting an object and apower source switch 11 which switches the power source on and off areprovided on left side surface Y1. Release switch 10 and power sourceswitch 11 are arranged below viewfinder 2, shooting lens 3, andlight-emitting unit 4.

[0033] A sound recording switch 12, which invokes sound recording, and acontinuous shooting mode switch 13, which allows switching of thecontinuous shooting mode during shooting are provided in right sidesurface Y2 opposite surface Y1. Like previously described release switch10 and power source switch 11, sound recording switch 12 and continuousshooting mode switch 13 are arranged below viewfinder 2, shooting lens3, and light-emitting unit 4. Moreover, sound recording switch 12 isformed substantially at the same height as release switch 10 on surfaceY1, so that the user does not feel a difference when the camera is heldeither by the right hand or the left hand.

[0034] Alternatively, the height of sound recording switch 12 andrelease switch 10 may differ so that when the user presses one switch,the switch provided in the opposite side surface is not accidentallypressed by the fingers of the user holding the other side surface.

[0035] Continuous shooting mode switch 13 is used to set shooting of oneframe or shooting of several frames of the object when release switch 10is pressed. For example, if the indicator of continuous shooting modeswitch 13 is switched to the “S” position or mode, only one frame isshot when release switch 10 is pressed. Moreover, if the indicator ofcontinuous shooting mode switch 13 is switched to the “L” position ormode and release switch 10 is pressed, the camera shoots eight framesper second while release switch 10 is pressed. In other words, shootingis accomplished under the low speed continuous shooting mode.Furthermore, if the indicator of continuous shooting mode switch 13 isswitched to the “H” position or mode and release switch 10 is pressed,the camera shoots 30 frames per second while release switch 10 ispressed. In other words, shooting is accomplished under the high speedcontinuous shooting mode.

[0036] Next, the internal structure of electronic camera 1 will bedescribed with respect to FIG. 3. A CCD 20 is provided in the rear step(surface X2 side) of shooting lens 3 and the optical image of the objectimaged through shooting lens 3 is photoelectrically converted into anelectric signal (picture image signal) and output.

[0037] Four cylindrical batteries (AAA dry cell batteries) 21 are placedside by side below LCD 6 and the electric power stored in batteries 21is supplied to each part. Moreover, a capacitor 22 is provided next tobatteries 21 to accumulate electric charge necessary to causelight-emitting unit 4 to emit light.

[0038] Various control circuits are formed on circuit board 23 tocontrol each part of electronic camera 1. Moreover, a removable memorycard (recording medium) 24 is provided between circuit board 23 and LCD6 and batteries 21, so that various information which is to be inputinto electronic camera 1 is recorded in the preassigned regions ofmemory card 24.

[0039] Moreover, in the present embodiment, memory card 24 is removable,but a memory on which various information can be recorded may beprovided on the circuit board 23. Moreover, various information recordedon memory card (or memory) 24 can also be output to an external personalcomputer or the like through an unrepresented interface.

[0040] Next, an example of the internal electrical structure of theelectronic camera of the present embodiment will be described withreference to FIG. 4. CCD 20, which is equipped with a plurality ofpixels, photoelectrically converts the optical image imaged on eachpixel into an image signal (electric signal). A CCD driving circuit(VDRV) 39 is controlled by a digital signal processor (hereafter, DSP)33, and drives CCD 20.

[0041] A correlation double sampling circuit (CDS) 31 samples thepicture image signals photoelectrically converted by CCD 20 with apreset timing. An AGC (automatic gain control circuit) 40 controls thegain of the signals sampled by CDS 31. An analog/digital (A/D)conversion circuit 32 digitizes the picture image signals sampled by CDS31, and supplies the result to DSP 33.

[0042] DSP 33 supplies the picture image data that has been digitized toa buffer memory 37, causing the information to be stored in memory. Amemory control circuit 38 reads the picture image data stored in buffermemory 37, and after being compressed by a JPEG (Joint PhotographicExperts Group) format, for example, is supplied to memory card 24 viadata bus 42, and is recorded in a preset picture image recording region.

[0043] In addition, CPU 34 has an internal timer circuit (not shown) andrecords the information about the date and time of shooting in thepicture image recording region of memory card 24 as header informationfor the picture image data. As a result, the shooting date and time dataare added to the picture image data recorded in the picture imagerecording region of memory card 24.

[0044] Microphone 8 inputs sound and supplies an analog sound signalcorresponding to this sound to a sound IC 36. Sound IC 36 converts thesound signal into a digital sound signal and, after compressing thissignal, supplies the result to memory card 24 where the data is recordedin a predetermined sound recording region. In addition, at this time therecording date and time data are recorded in the sound recording regionof memory card 24 as header information for the sound data.

[0045] In addition, strobe 4 is controlled by CPU 34 and emits lightwith a preset timing to illuminate the object.

[0046] When a preset position on touch tablet 6A is pressed by pen 6Boperated by the user, CPU 34 reads the X-Y coordinates corresponding tothe position pressed on touch tablet 6A, and accumulates this coordinatedata (comprising the below-described line drawing information) in anunrepresented predetermined memory. In addition, CPU 34 supplies theline drawing information accumulated in the memory to memory card 24along with header information such as the date and time when the linedrawing information was input, and records this information in the linedrawing information recording region.

[0047] A buffer memory 37 and LCD 6 are connected to CPU 34 via a CPUcontrol bus 41, and the picture image corresponding to the picture imagedata stored in buffer memory 37 can be displayed on LCD 6. However, thepicture image data that has undergone compression processing is inputinto memory control circuit 38 once and after being decompressed is thensupplied to buffer memory 37 via data bus 42.

[0048] In addition, a speaker 5 is connected to sound IC 36 and thesound data read from memory card 24 is decompressed and converted intoan analog sound signal by sound IC 36, and is then output by speaker 5or to an unrepresented earphone connected to earphone jack 9.

[0049] In addition, when the operation switch (SW) and a switch such asrelease switch 10, power source switch 11, sound recording switch 12, orcontinuous shooting mode switching switch 13 are operated, a signalcorresponding to this operation is supplied to CPU 34. Furthermore, CPU34 executes the corresponding predetermined process when the switchesare operated.

[0050] Next, these actions will be described. First, the sound input andoutput process in the present embodiment will be described. When thepower source switch shown in FIG. 1 is switched to “ON”, power issupplied to electronic camera 1, and when sound recording switch 12provided on surface Y2 is pressed, the recording process is started. Thesound input via microphone 8 is converted into digital sound data bysound IC 36, and after a compression process has been performed, thedata is supplied to memory card 24 and is recorded in the soundrecording region of memory card 24. At this time, data such as therecording date and time is recorded as header information for thecompressed sound data in the sound recording region of memory card 24.This kind of action is repeatedly executed while sound recording switch12 is pressed.

[0051] A PCM (Pulse Code Modulation) method or some other method can beused as the sound compression method.

[0052] Next, the actions involved in shooting an object will bedescribed. First, the case when continuous shooting mode switchingswitch 13 provided in surface Y2 is switched to the S mode (the modethat accomplishes shooting of only one frame) will be described. First,as shown in FIG. 1, power is supplied to electronic camera 1 when thepower source switch provided on surface Y1 is switched to “ON”. When theobject is verified using viewfinder 2 and release switch 10 provided onsurface Y1 is pressed, the object shooting process is started.

[0053] The optical picture image of the object observed using viewfinder2 is condensed by shooting lens 3 and is composed into an image on CCD20 provided with a plurality of pixels. The optical picture image of theobject imaged on CCD 20 is photoelectrically converted into a pictureimage signal in each pixel and is sampled by CDS 31. The picture imagesignal sampled by CDS 31 has the gain thereof controlled by AGC 40, andis supplied to A/D conversion circuit 32 and is digitized and thensupplied to DSP 33.

[0054] DSP 33 supplies the digitized picture image data to buffer memory37 where this data is stored. Memory control circuit 38 compresses thepicture image data read from the buffer memory in accordance with theJPEG format that is a combination of the discrete cosine transformation,quantization and Huffman encoding. Memory control circuit 38 suppliesthe compressed picture image data to memory card 24 via data bus 42.Memory card 24 records the picture image data supplied from memorycontrol circuit 38 in the picture image recording region. At this time,the shooting date and time data is recorded as header information forthe above-described picture image data in the picture image recordingregion of memory card 24.

[0055] When continuous shooting mode switch 13 is switched to the Smode, one frame of shooting is accomplished each time release switch 10is pressed. Accordingly, even if release switch 10 is pressed andcontinuously held in this pressed position, only shooting of one frameis accomplished. In addition, when release switch 10 is continuouslypressed for only a predetermined length of time, it is possible for thepicture image just shot to be displayed on LCD 6.

[0056] Next, the case wherein continuous shooting mode switch 13 isswitched to the L mode (the mode that accomplishes continuous shootingof 8 frames per second) will be described. Power is supplied toelectronic camera 1 when power source switch 11 is switched to “ON”, andwhen release switch 10 provided on the surface Y1 is pressed, the objectshooting process is started as follows.

[0057] The light from the object observed using viewfinder 2 iscondensed by shooting lens 3, and is composed into an image on CCD 20provided with a plurality of pixels. The optical picture image of theobject imaged on CCD 20 is photoelectrically converted into a pictureimage signal in each pixel and is sampled by CDS 31 at a rate of eighttimes per second. In addition, of the picture image electrical signalscorresponding to all of the pixels from CCD 20, CDS 31 at this timethins out those corresponding to three-fourths of the pixels.

[0058] The picture image signals sampled by CDS 31 (the picture imagesignals of one-fourth of all the pixels of CCD 20) are supplied to A/Dconversion circuit 32, and are digitized and output to DSP 33.

[0059] The digitized picture image data is supplied from DSP 33 tobuffer memory 37 and is stored. Furthermore, the picture image datastored in buffer memory 37 is read out by memory control circuit 38 andis compressed in accordance with the JPEG format. The picture image datais supplied to memory card 24 via data bus 42, and is recorded in thepicture image recording region. At this time, the shooting date and timedata is recorded in the picture image recording region of memory card 24as header information for this picture image data. In addition,predetermined discrimination information indicating that the pictureimage is one of the continuously shot picture images is inserted intoeach header information for the picture image data continuously shot.Through this, CPU 34 can discriminate whether or not the picture imagesrecorded on memory card 24 are picture images comprising thecontinuously shot picture images.

[0060] Next, the case wherein continuous shooting mode switch 13 isswitched to the H mode (the mode that accomplishes continuous shootingof 30 frames per second) will be described. Power is supplied toelectronic camera 1 when the power source switch 11 is switched to “ON”,and when release switch 10 provided on the surface Y1 is pressed, theobject shooting process is started as follows.

[0061] Light from the object observed using viewfinder 2 is condensed byshooting lens 3 and is composed into an image on CCD 20. The opticalpicture image of the object imaged on CCD 20, which is provided with aplurality of pixels, is photoelectrically converted into a picture imagesignal in each pixel and is sampled by CDS 31 at a rate of 30 times persecond. In addition, of the picture image electrical signalscorresponding to all of the pixels from CCD 20, CDS 31 at this timethins out those corresponding to eight-ninths of the pixels.

[0062] The picture image signals sampled by CDS 31 (the picture imagesignals of one-ninth of all the pixels of CCD 20) are supplied to A/Dconversion circuit 32, and are there digitized and output to DSP 33.

[0063] DSP 33 supplies the digitized picture image data to buffer memory37 and causes the data to be stored there. Furthermore, memory controlcircuit 38 reads the picture image data from buffer memory 37 andcompresses this in accordance with the JPEG format. In this way, thedigitized and compressed picture image data is supplied to memory card24 via data bus 42, and is recorded in the picture image recordingregion of memory card along with header information such as the shootingdate and time. In addition, predetermined discrimination informationindicating that the picture image is one of the continuously shotpicture images is inserted into each header information for the pictureimage data continuously shot, the same as in the L mode. Through this,CPU 34 can discriminate whether or not the picture images recorded onmemory-card 24 are picture images comprising the continuously shotpicture images.

[0064] During shooting of the object, strobe 4 operates as necessary toilluminate the object with light.

[0065] Next, the actions will be described for the case whereintwo-dimensional information (pen input information) is input using touchtablet 6A. When the tip of pen 6B touches touch tablet 6A, datacorresponding to the X-Y coordinates of the location that is touched isinput to CPU 34. The data corresponding to these X-Y coordinates issupplied to CPU 34, which reads the picture image data corresponding toa point of predetermined size, for example, at the positioncorresponding to the X-Y coordinates of buffer memory 37 on the basis ofthis data corresponding to the X-Y coordinates, and through the controlfrom CPU 34, a point of predetermined size is displayed at thecorresponding position on LCD 6.

[0066] As described above, touch tablet 6A formed on the surface of LCD6 is composed of a transparent member, and consequently it is possiblefor the user to observe the point displayed at the position where touchtablet 6A is pressed by the tip of pen 6B on LCD 6, and it is possibleto convey a feeling just like accomplishing pen input directly onto LCD6. In addition, when pen 6B is moved while in contact with touch tablet6A, a line is displayed on LCD 6 along the locus over which pen 6Bmoves. Furthermore, when pen 6B is caused to move intermittently ontouch tablet 6A, a dashed line is displayed on LCD 6 in accordance withthe movement of pen 6B. In this way, the user can input the line drawinginformation of the desired text or diagram or the like using touchtablet 6A (LCD 6).

[0067] In addition, when the picture image is displayed on LCD 6, ifline drawing information such as text or the like, for example, is inputusing pen 6B, this line drawing information is formed by buffer memory37 along with the picture image information, and is displayed on LCD 6simultaneously.

[0068] The user, by operating an unrepresented color selection switch,can select from among a plurality of colors such as black, white, red,or blue as the color of the line drawing displayed on LCD 6.

[0069] After the line drawing information has been input by pen 6B andtouch tablet 6A, when execution key 7B is pressed, the line drawinginformation accumulated in a predetermined memory is supplied to memorycard 24 via CPU control bus 41 along with the header informationincluding the input date and time, and is recorded in the line drawinginformation recording region of memory card 24.

[0070] In this way, the line drawing information recorded on memory card24 is information on which a compression process is executed. The linedrawing information input using touch tablet 6A contains a large amountof information with high spatial frequency components, and consequentlywhen the compression process is accomplished using the JPEG format usedin compressing the picture image, the compression efficiency is poor andthe amount of information is not reduced very much. In addition,compression under the JPEG format is non-reversible compression, andconsequently is not suitable for compression of a small amount of linedrawing information. This is because when the information isdecompressed and displayed on LCD 6, gathers and smears accompanyingdefects in the information are displayed.

[0071] Hence, in this embodiment, the line drawing information iscompressed for example using a run length method used in fax machinesand the like. The run length method is a method that compresses the linedrawing information by scanning the line drawing in the horizontaldirection and encoding the length over which the information (points) ofvarious colors such as black, white, red, or blue continue, and thelength over which a lack of information (an absence of pen input)continues.

[0072] By using this run length method, it is possible to efficientlycompress the line drawing information, and in addition, it is possibleto suppress defects in the information even when the compressed linedrawing information is decompressed. When the amount of information inthe line drawing information is relatively low, it is also possible tonot compress this.

[0073] In addition, when the picture image is displayed on LCD 6, if peninput is performed, the picture image data and the line drawinginformation input by the pen are combined in buffer memory 37, and thecombination image of the picture image and the line drawing is displayedon LCD 6. However, in memory card 24, the picture image data is recordedin the picture image recording region and the line drawing informationis recorded separately in the line drawing information recording region.In this way, the two sets of information are recorded in differingregions, and the user can erase either from the combined image of thepicture image and the line drawing. In addition, it is possible tocompress the picture image information using an individual compressionmethod and to record this information.

[0074] When data is recorded on at least one of the sound recordingregion, the picture image recording region, and the line drawinginformation recording region of memory card 24, it is possible todisplay on LCD 6 a table display screen showing a table of the recordedinformation, as shown in FIG. 5. In the table display screen of LCD 6shown in FIG. 5, the date 50 when the information was recorded (in thiscase, Aug. 25, 1995) is displayed in the lower portion of the screen,and the recording time 52 when the information was recorded on thisrecording date is displayed on the left-most side of the screen.

[0075] To the right of the recording time, a thumbnail picture image 54is displayed when picture image data is recorded. This thumbnail pictureimage is a reduced picture image created by thinning the bitmap data ofeach picture image of the picture image data recorded in memory card 24.Accordingly, the information that the thumbnail picture image displaysis information containing the picture image information. That is to say,in the information recorded (input) at “10:16” and “10:25”, the pictureimage information is included, and in the information recorded at“10:05”, “10:28”, “10:54” and “13:10”, the picture image information isnot included.

[0076] In addition, the memo symbol “*” indicates that a predeterminedmemo is recorded as line drawing information.

[0077] Furthermore, on the right side of the display region for thethumbnail picture image, a sound information bar 56 is displayed, and abar (line) having a predetermined length corresponding to the timeinterval during which the sound was recorded is displayed. When soundinformation has not been recorded, this sound information bar is notdisplayed.

[0078] The user selects the information to be reproduced by pressing thetip of pen 6B in the square region where the desired information isdisplayed in the screen shown in FIG. 5, and commands the reproductionof the selected information by pressing the tip of pen 6B on executionkey 7B shown in FIG. 2.

[0079] For example, when the band-shaped region where “10:05” isdisplayed is pressed by pen 6B on the screen shown in FIG. 5, CPU 34instructs sound IC 36 to reproduce the sound corresponding to theselected recording date and time (10:05).

[0080] The sound IC reads the sound data from memory card 24 inaccordance with the command from CPU 34, and after a decompressionprocess has been executed and the information has been converted into ananalog signal, the signal is output from speaker 5. When an earphone isconnected to earphone jack 9, sound is not output from speaker 5, but isoutput from the earphone.

[0081] When the picture image data recorded on memory card 24 isreproduced, the user selects the information by pressing the desiredthumbnail picture image with the tip of pen 6B, and then pressesexecution key 7B to command reproduction of the selected information.

[0082] The picture image data corresponding to the selected thumbnailpicture image is read from memory card 24 and is decompressed in memorycontrol circuit 38. The decompressed picture image data is supplied tobuffer memory 37 via data bus 42, and is stored in the memory as bitmapdata. Next, the control signal corresponding to the picture image datastored in buffer memory 37 is supplied to LCD 6 by CPU 34, and thecorresponding picture image is displayed.

[0083] At this time, when sound data has also been recorded (forexample, in cases where the recording times are “10:16” and “10:21”) itis also possible for the sound to be output from speaker 5, as describedabove.

[0084] Next, the sequence of actions when picture image dataphotographed using the continuous shooting mode and stored in memorycard 24 is reproduced will be described with reference to the flowchartin FIG. 6.

[0085] First, in step S1, the table display screen such as that shown inFIG. 5 is displayed on LCD 6, and the picture image to be reproduced isselected by pressing a predetermined position on touch tablet 6Acorresponding to the picture image to be reproduced, using pen 6B or thelike. Next, the command to reproduce the picture image just selected ismade by pressing on the position on touch tablet 6A corresponding to theposition where execution key (EXEC) 7B is displayed, using pen 6B. Touchtablet 6A supplies the position information corresponding to theposition pressed by pen 6B to CPU 34.

[0086] Next, the sequence moves to step S2 and CPU 34 recognizes thepicture image that was selected from the position information suppliedfrom touch tablet 6A, and recognizes that the reproduction of such wascommanded. Furthermore, commands are sent to memory control circuit 38to reproduce the picture image selected in step S1. Memory controlcircuit 38 reads the picture image data corresponding to the pictureimage designated for reproduction in accordance with the commands fromCPU 34, and stores this in buffer memory 37. Next, memory controlcircuit 38 executes the decompression process on the picture image datastored in buffer memory 37.

[0087] CPU 34 controls LCD 6 on the basis of the decompressed pictureimage data stored in buffer memory 37, and displays the picture imagecorresponding to this picture image data on the screen of LCD 6.

[0088] In step S3, a determination is made by CPU 34 as to whether ornot the picture image displayed on LCD 6 is one of the picture imagesphotographed in the continuous shooting mode (“a continuously shotpicture image”). This determination can be made on the basis of presetdiscrimination information indicating whether or not the image is acontinuously shot picture image in the header information correspondingto the picture image data stored in memory card 24.

[0089] When the picture image displayed on LCD 6 is determined to be apicture image comprising a continuously shot picture image in step S3,the sequence advances to step S4.

[0090] In step S4, CPU 34 commands sound IC 36 to reproduce the soundcorresponding to each picture image that comprises the continuously shotpicture image photographed using the continuous shooting mode, in orderfrom the sound corresponding to the picture image photographed first.Sound IC 36 reads the sound corresponding to each picture imagecomprising the continuously shot picture image from memory card 24 inorder from the sound corresponding to the picture image photographedfirst, in accordance with the commands from CPU 34, and accomplishessuccessive reproduction. That is, after the decompression process hasbeen executed, the information is converted into an analog signal and isoutput from speaker 5. When an earphone is connected to earphone jack 9,the sound is output through the earphone.

[0091] The picture images comprising the continuously shot picture imageand the sound have a one-to-one correspondence, for example as shown inFIG. 7. That is, in this drawing, the continuously shot picture image iscontinuously shot at a rate of 8 frames per second (the time betweentime t0 and time t8), for example, and during this interval continuouslyshot picture images P1 through P8 are photographed. Furthermore, thesound A1 corresponding to the picture image P1 is recorded during theinterval between time t0 and time t1, and the sound A2 corresponding tothe picture image P2 is recorded during the interval between time t1 andtime t2. Similarly, the sounds A3 through A8 are recorded.

[0092] Accordingly, when the picture image selected in step S1 is, forexample, the picture image P5 comprising one of the continuously shotpicture images P1 through P8, sound IC 36 reproduces the sound A1through A8 in order. Regardless of which of the picture images P1through P8 comprising the continuously shot picture image is selected,sound IC 36 reproduces the sound A1 through A8 in order. When theprocess of reproducing the sound in step S4 is concluded, the process iscompleted.

[0093] On the other hand, when it is determined in step S3 that thepicture image displayed on LCD 6 is not a picture image comprising thecontinuously shot picture image, the sequence advances to step S5,wherein CPU 34 sends commands to sound IC 36 to reproduce only the soundcorresponding to the selected picture image. Sound IC 36 reads only thesound commanded by CPU 34 from memory card 24, executes a decompressionprocess and converts this to an analog sound signal, and then outputsthe corresponding sound through speaker 5 or an earphone connected toearphone jack 9. Then, the process is concluded.

[0094] In the above-described embodiment, the case where the sound andpicture images comprising a continuously shot picture image have aone-to-one correspondence as shown in FIG. 7 was explained, but as shownin FIG. 8, it is also possible for the continuously shot picture imagesP1 through P8 and the sound recorded during continuous shooting (in thiscase, during one second) to have a many-to-one correspondence.Accordingly, the sound A is reproduced when the picture image P5 iselected, for example. That is to say, in this case in the sound A isreproduced regardless of which of the picture images P1 through P8 isselected.

[0095] In addition, for example in the event that the picture image P5is selected, when the sound A is silent for example from time t0 throughtime t4 it is possible to reproduce only the sound from time t4 on.Similarly, when the sound is silent between time t0 and time t2, it ispossible to reproduce only the sound from time t2 on. In addition, incases where there is silence between time t0 and time t5, it is possibleto reproduce only the sound from time t5 on, and it is also possible toreproduce the sound starting with time t4, when the picture image P5 wasphotographed.

[0096] In this way, when one of the picture images that comprises thecontinuously shot picture image continuously shot at a rate of eightframes per second, for example, is selected and this is reproduced anddisplayed on LCD 6, it is possible to reproduce all of the soundrecorded during the continuous shooting time (e.g., one second), andconsequently it is possible to eliminate the problem of the reproductiontime of the sound corresponding to the picture image displayed on LCD 6being too short, such as ⅛ of a second, for example, so that recognitionis impossible.

[0097] In addition, when a portion of the sound is silent, it ispossible to not reproduce this portion, and it is also possible toaccomplish efficient reproduction of the recorded data.

[0098] In addition, in the present embodiment only one microphone wasprovided, but it is also possible to provide two microphones, on theright and the left, and to record the sound in stereo.

[0099] In addition, in the present embodiment the various types ofinformation were input using a pen-type pointing device, but it is alsopossible to input this information using a finger.

[0100] In addition, in the above-described embodiment, it is possible toset the continuous shooting mode to an L mode that photographs eightframes in one second, and an H mode that shoots 30 frames in one second,but this is intended to be illustrative and not limiting, for it is alsopossible to shoot an arbitrary number of frames per second.

[0101] Furthermore, the display screen shown on LCD 6 is only oneexample, and the screen is not limited to this, for it is possible touse screens with various layouts. Similarly, the types of operation keysand the layout are also merely examples, and are intended to beillustrative and not limiting.

[0102] With the information input apparatus of the present invention,when one picture image that comprises the predetermined continuouslyshot picture image is selected and reproduced, all of the soundcorresponding to the continuously shot picture image of which thispicture image is a constituent element is reproduced, and consequentlyit is possible to make it so the user can tell no difference in thesound associated with the reproduced picture image.

What is claimed is:
 1. An information input apparatus, comprising:imaging means for imaging a picture image; sound input means forinputting sound; a memory for storing the picture image imaged by theimaging means and the sound corresponding to the picture image input bythe sound input means, and for storing a continuously shot picture imagecomprising a plurality of picture images imaged continuously in apredetermined time period by the imaging means and sound correspondingto the continuously shot picture image input by the sound input means;picture image reproduction means for reproducing the picture imagesstored in the memory; sound reproduction means for reproducing the soundstored in the memory; selection means for selecting among the pictureimages stored in the memory; and control means for controlling thepicture image reproduction means to reproduce the selected picture imageand the sound reproduction means to reproduce the sound corresponding tothe continuously shot picture image containing the selected pictureimage, if the selected image is one image of the continuously shotpicture image.
 2. The information input apparatus of claim 1, wherein:the sound is stored in the memory with an association to each of thepicture images that comprise the continuously shot picture image.
 3. Theinformation input apparatus of claim 1, wherein: the control meansaccomplishes control so that when one of the picture images thatcomprise the continuously shot picture image is selected by theselection means, the sound reproduction means reproduces the soundcorresponding to the entire continuously shot picture image.
 4. Theinformation input apparatus of claim 1, wherein: the control meansaccomplishes control so that when one of the picture images other thanthe first picture image of the continuously shot picture image isselected by the selection means, the sound corresponding to thecontinuously shot picture image from the middle of the continuously shotpicture image is reproduced.
 5. The information input apparatus of claim1, wherein: the memory stores predetermined information indicatingwhether or not a picture image is a picture image comprising acontinuously shot picture image.
 6. The information input apparatus ofclaim 1, further comprising: display means for displaying the pictureimages imaged by the imaging means and the picture images reproduced bythe picture image reproduction means; and sound output means foroutputting the sound input by the sound input means and the soundreproduced by the sound reproduction means.
 7. The information inputapparatus of claim 1, further comprising illumination means for emittingilluminating light toward the object.
 8. An information input apparatus,comprising: an imaging unit for imaging picture images; a microphone forinputting sound; a memory for storing the picture images and the soundassociated with the picture images, the memory adapted to store a rangeof continuously shot picture images and the sound associated with therange of continuously shot picture images; a reproduction unit forreproducing the picture images and the sound stored in the memory; auser interface for allowing selection of the picture images to bereproduced; and a controller responsive to the user interface forcontrolling the reproduction unit to reproduce the selected pictureimage and the sound associated with the picture image, and, if theselected picture image is one of the range of continuously shot pictureimages, reproducing the selected picture image and the sound associatedwith the entire range of the continuously shot picture images.
 9. Theinformation input apparatus of claim 8, wherein: the sound is stored inthe memory with an association to each of the picture images thatcomprise the continuously shot picture image.
 10. The information inputapparatus of claim 8, wherein: the controller accomplishes control sothat when one of the picture images other than the first picture imageof the range of continuously shot picture images is selected, the soundcorresponding to the range of continuously shot picture images isreproduced, beginning with the picture image in the range where audiblesound is first recorded.
 11. The information input apparatus of claim 8,wherein: the memory stores predetermined information indicating whetheror not a picture image is one of a range of continuously shot pictureimages.
 12. The information input apparatus of claim 8, furthercomprising: a display for displaying the picture images imaged by theimaging unit and the picture images reproduced by the reproduction unit;and a speaker outputting the sound input by the microphone and the soundreproduced by the reproduction unit.
 13. The information input apparatusof claim 8, further comprising a strobe for emitting illuminating lighttoward the object.
 14. The information input apparatus of claim 8,wherein said apparatus is an electronic digital camera, and said imagingunit includes a lens and a photoelectric conversion device.
 15. A methodfor recording and reproducing picture images, comprising the steps of:imaging a plurality of picture images during a predetermined period;recording sound associated with the picture images during thepredetermined period; storing the picture images and the soundassociated with the picture images; selecting among the stored pictureimages to be reproduced; and reproducing the selected picture image andthe sound recorded during the predetermined period in which the selectedimage was recorded.
 16. The method of claim 15, wherein: the sound isstored with an association to each of the picture images recorded duringthe predetermined period.
 17. The method of claim 15, wherein the soundcorresponding to the entire predetermined period in which the selectedpicture image was recorded is reproduced.
 18. The method of claim 15,wherein the sound corresponding to the predetermined period in which theselected picture image was recorded is reproduced beginning at the pointin which audible sound is first recorded.
 19. The method of claim 15,further comprising the step of imaging a single image during a secondpredetermined period.
 20. The method of claim 19, wherein: the storingstep includes storing information indicating whether a picture image isone of a plurality of picture images recorded during the predeterminedperiod or a single picture image recorded during the secondpredetermined period.
 21. The method of claim 15, further comprising:displaying the picture images and outputting the recorded sound.
 22. Themethod of claim 15, further comprising: emitting illuminating lighttoward an object to be imaged.
 23. The method of claim 15, wherein saidsteps are performed by an electronic digital camera.